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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
November 4, 2009 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-6 and 15-27 have been 
considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1 , 3-6, and 1 5-27 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Laird et al. (6,647,361) in view of Moran et al. (U.S. Patent 
6,332,147). 
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Regarding claim 1, Laird et al. discloses a testing system for collecting, 
storing, and reviewing digital data, serial data, and video data related to events 
occurring in an automated system comprising a plurality of subsystems 
comprising an automated controller and at least one peripheral sensor under the 
direction of the automated controller, the testing system comprising: a) a digital 
signal capture card for sensing and collecting discrete digital signals from the 
automated system as digital data (Figs. 28 and 29 - memory fields 765, 767, and 
803; col. 23, lines 62-64; col. 24, lines 3-5; col. 25, lines 16-1 7 -these memory 
fields indicate whether the car is a violator or non-violator and the current traffic 
light phase); b) a multi-port serial port expansion card for sensing and collecting 
digital communication messages between subsystems as serial data (Figs. 28 
and 29; col. 23, line 46 - col. 25, line 6 - speeds and times are all collected and 
stored; the subsystems can be seen in Fig. 5); c) a video frame grabber and 
compression card for sensing and collecting video signals as video data (Figs. 
28, 29, and 32); d) a device for indexing and storing the digital data, serial data, 
and video data with time tags (Figs. 28 and 29; the time tag can be seen in Fig. 
32 in the section designated by reference character "820"), wherein said time 
tags are used for relating occurrence of a particular item of a particular data type, 
whether digital data, serial data, or video data, to the most closely time-related 
data item from the other data types (Figs. 28, 29, and 32 - all data is stored 
accordingly and displayed together for review); and e) a display for control of the 
testing system and presentation of said digital data, serial data, and video data to 
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a user during review (Fig. 32; col. 26, line 65 - col. 28, line 32). However, Laird 
et al. fails to disclose a display for control of said testing system and presentation 
of said digital data, serial data, and video data in separate windows on the 
display to a user during review; and wherein the display displays each data type, 
whether digital data, serial data, or video data, in a time-synchronized manner in 
the separate windows based on the time tags. 

Referring to the Moran et al. reference, Moran et al. discloses a system for 
collecting, storing, and reviewing related digital data, serial data, and video 
wherein the presentation of said digital data, serial data, and video data is 
separate windows on the display to a user during review; and wherein the display 
displays each data type, whether digital data, serial data, or video data, in a time- 
synchronized manner in the separate windows based on the time tags (Fig. 4; 
col. 19; lines 1-65). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have the digital data, serial data, and video 
data in separate windows on the display during review as well as being time- 
synchronized as disclosed by Moran et al. in the system disclosed by Laird et al. 
in order to have provided the user with a simple interface that displays all linked 
material to the user at once. 

Regarding claim 3, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
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reviewed video data are presented in picture format of still image or time-motion 
video images on the display during review (Laird et al.: Fig. 32). 

Regarding claim 4, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
reviewed serial communication data are presented in time-ordered message 
sequence (Laird et al.: Fig. 32 - details window (820) on the display during 
review; col. 27, lines 41-52). 

Regarding claim 5, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 , including that the 
reviewed serial communication data are presented as recorded in hexadecimal 
or ASCII format during review (Laird et al.: Fig. 32 displays ASCII characters). 

Regarding claim 6, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
reviewed serial communication data are translated according to message parsing 
rules during review (Laird et al.: Fig. 32 displays the time and information in the 
correct format - parsing is the process of analyzing a sequence of tokens 
(codes) to determine its grammatical structure with respect to a given formal 
grammar). 

Regarding claim 15, Laird et al. discloses a method of testing and 
evaluating an automated system comprising a plurality of subsystems comprising 
an automated controller and at least one peripheral sensor, the method 
comprising the steps of: a) operatively interconnecting a testing system to the 
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automated system (Fig. 5); b) collecting discrete digital signals of the automated 
system as digital data with the testing system (Figs. 28 and 29 - memory fields 
765, 767, and 803; col. 23, lines 62-64; col. 24, lines 3-5; and col. 25, lines 16-17 
- these memory fields indicate whether the car is a violator or non-violator and 
the current traffic light phase); c) monitoring for serial digital communication 
messages between the subsystems with the testing system and collecting the 
serial communication messages as serial data (Figs. 28 and 29; col. 23, line 46- 
col. 25, line 6 - speeds and times are collected and stored; the subsystem can be 
seen in Fig. 5); d) collecting video images of the automated system as video data 
(Figs. 28, 29, and 32); e) indexing said digital data, serial data, and video data 
with time tags (Figs. 28 and 29); f) recording said digital data, serial data, and 
video data on a hard disk drive of the testing system; and g) displaying said 
digital data, serial data, and video data on a single display in a time- 
synchronized manner based on time tags (Figs. 28, 29, and 32 - all data is 
stored accordingly and displayed together for review). However, Laird et al. fails 
to disclose displaying said digital data, serial data, and video data in separate 
windows on a single display in a time- synchronized manner based on time tags. 

Referring to the Moran et al. reference, Moran et al. discloses a method 
for collecting, storing, and reviewing related digital data, serial data, and video 
wherein the presentation of said digital data, serial data, and video data is 
separate windows on the display to a user during review; and wherein the display 
displays each data type, whether digital data, serial data, or video data, in a time- 
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synchronized manner in the separate windows based on the time tags (Fig. 4; 
col. 19; lines 1-65). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have the digital data, serial data, and video 
data in separate windows on the display during review as well as being time- 
synchronized as disclosed by Moran et al. in the method disclosed by Laird et al. 
in order to have provided the user with a simple interface that displays all linked 
material to the user at once. 

Regarding claim 16, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 including that wherein 
step d) comprises the sub-step of storing said digital data, serial data, and video 
data on a computer hard drive (Laird et al.: col. 30, lines 22-39 - hard drive). 

Regarding claim 17, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 as well as the method 
further comprising the step of searching said digital data, serial data, and video 
data for a particular event, a sequence of events, or a combination of events 
(Laird et al.: Fig. 32 - the person reviews the information (searches the 
information) to see if the cars were in violation of the traffic light). 

Regarding claim 18, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 including that steps 
a), b), and c) occur simultaneously over a common time period (Laird et al.: Fig. 
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32 - all information is combined based on their time for the viewer to get an 
overall sense of what happened). 

Regarding claim 20, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 including that wherein 
step b) comprises the substep of monitoring with the testing system for discrete 
digital signals of the peripheral sensor in parallel without affecting the automated 
system and collecting the discrete digital signals (Laird et al.: Figs. 4 and 32; col. 
26, line 65 - col. 28, line 32; Moran et al.: Fig. 4; col. 19; lines 1-65). 

Regarding claim 21, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 including that the 
method further comprises the step of automatically slewing the separate windows 
of the remaining two data types to a display time selected by a user for one of the 
separate windows of any individual data type, whether digital data, serial data, or 
video data (Moran et al.: Fig. 4; col. 19; lines 1-65). 

Regarding claim 22, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15 including that the 
method further comprises the step of regenerating the discrete digital signals 
from the digital data and supplying the discrete digital signals as inputs to the 
automated system in a format and a timing of an original recording to simulate 
the original recording (Laird et al.: Figs. 4 and 32; col. 26, line 65 - col. 28, line 
32; Moran et al.: Fig. 4; col. 19; lines 1-65). 
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Regarding claim 23, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claims 15 and 22 including 
that the further comprises the step of evaluating a response by the automated 
system to the inputs (Laird et al.: Figs. 4 and 32; col. 26, line 65 - col. 28, line 32; 
Moran et al.: Fig. 4; col. 19; lines 1-65). 

Regarding claim 24, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that when the 
user selects a display time of one of the separate windows of any individual data 
type, whether digital data, serial data, or video data, the separate windows of the 
remaining two data types are automatically slewed to the display time (Moran et 
al.: Fig. 4; col. 19; lines 1-65). 

Regarding claim 25, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
testing system monitors for the discrete digital signals of the automated system in 
parallel without affecting the automated system (Laird et al.: Figs. 4 and 32; col. 
26, line 65 - col. 28, line 32; Moran et al.: Fig. 4; col. 19; lines 1-65). 

Regarding claim 26, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
testing system accommodates various data modes of the digital data and the 
serial data in their original format to and from the automated system without 
modification of the automated system (Laird et al.: Figs. 4 and 32; col. 26, line 65 
- col. 28, line 32; Moran et al.: Fig. 4; col. 19; lines 1-65). 
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Regarding claim 27, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
testing system monitors an original signal of the digital data in parallel without 
affecting the automated system (Laird et al.: Figs. 4 and 32; col. 26, line 65 - col. 
28, line 32; Moran et al.: Fig. 4; col. 19; lines 1-65). 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 2 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Laird et al. in view of Moran et al. as applied to claims 1 and 15 above, and further in 
view of Auty etal. (U.S. Patent 5,809,161). 

Regarding claim 2, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 1 , but fails to disclose 
that the reviewed discrete digital data are presented in graphical strip chart 
format on the display during review. 

Referring to the Auty et al. reference, Auty et al. discloses reviewing traffic 
information wherein the reviewed discrete digital data are presented in graphical 
strip chart format on the display during review (Fig. 16). 
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Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have graphically shown digital data as taught 
by Auty et al. in the system as disclosed by Laird et al. in view of Moran et al. in 
order to allow the reviewer to easily correlate related data visually. 

Regarding claim 19, Laird et al. in view of Moran et al. discloses all the 
limitations as previously discussed with respect to claim 15, but fails to explicitly 
disclose that the method further comprises the step of providing a status 
feedback to a system operator, wherein the status feedback comprises a 
duration of recording, a current state of said digital data, serial data, and video 
data, and a total number of state changes of said digital data, serial data, and 
video data. 

Referring to the Auty et al. reference, Auty et al. discloses reviewing traffic 
information wherein the reviewed discrete digital data are presented in graphical 
strip chart format on the display during review which would provide the user with 
status feedback, wherein the status feedback comprises a duration of recording, 
a current state of said digital data, serial data, and video data, and a total number 
of state changes of said digital data, serial data, and video data (Fig. 16). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have included status feedbacks to the user 
as disclosed by Auty et al. in the system as disclosed by Laird et al. in view of 
Moran et al. in order to allow the reviewer to easily correlate related data visually. 



Application/Control Number: 10/603,443 Page 12 

Art Unit: 2621 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HEATHER R. JONES whose telephone number is 
(571 )272-7368. The examiner can normally be reached on Mon. - Thurs.: 7:00 am - 
4:30 pm, and every other Fri.: 7:00 am - 3:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached on 571-272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Heather R Jones 
Examiner 
Art Unit 2621 

HRJ 

February 13, 2010 
/Thai Tran/ 

Supervisory Patent Examiner, Art Unit 2621 



